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(54) An endoscopic surgical Instrument 

(57) An endoscopic surgical instrument (142) com- 
prising a control section and an insertion section, the 
insertion section being adapted to be inserted into a 
patient through a small incision (1 80); wherein the inser- 
tion section (145) conprises a forearm link (174), a 
wrist link (172) and an end effector (170), wherein the 
forearm link (1 74) has a proximal end. a distal end and 
a forearm axis extending longitudinally from the proxi- 
mal end of the forearm link (174) to the distal end of the 
forearm link (174). the wrist link (172) has a proximal 
eridandadistalendandawri6taxisextencing from the 
proximal end of the forearm link (174) to the distal end 
of the forearm link (174), the proximal end of the fore- 
arm fink (174) is connected to the control section (143), 
the distal end of the forearm link (174) is connected to a 
pivotal wrist joint, and the proximal end of the wrist link 
(172)isa)nriededtothepivo^ 
end of the wrist Bnk (172) is connected to the end effec- 
tor (1 70), characterized in that the control section com- 
prises a plurality of control motors and linkages (182, 
184, 186, 188) adapted to operate the insertion section 
with at least five degrees of freedom Inducing: insertion 
and retraction of a forearm link (174) along the forearm 
axis and through the small incision (180); rotation of the 
forearm Bnk (1 74) about the forearm axis; pivotal motion 
of the forearm irk (1 74) about a first pivotal axis and a 
second pivotal axis which are perpendicular to each 
other and intersect the forearm axis at a pivot point 
acQacentthe small incision (180); and pivotal motion of 
a wrist fink (172) relative to the forearm link (174). 
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Description 

This invention relates to an endoscopic surgical 
instrument. 

Teieoperating, which is well known, includes the 
human performance of tasks at a remote location using 
manipulators. Telepresence includes providing the tele- 
operator with the same feedback and control that he 
would have were he actually at the worksite carrying out 
the operation wfth his own hands. Telepresence opera- 
tion generally includes use of a stationary visual display; 
particularly a stereographte visual display of the remote 
workspace. Stereoscopic television systems are weO 
known as shown, for example, in US Patent Numbers 
4,562,463 and 4,583,117 and in UK Patent Application 
GB 2.040,134. 

Remote manipulators enptaying stereoscopic TV 
viewing together with force feedback also are wef 
known as shown, for example, to an article entitled, 
"Controlling Remote Manipulators Through Kinesthetic 
Coupling," Bejczy el al. Computers In Mechanical Engi- 
neering, July 1983, pps. 48-60, and in an article entitled, 
"Stereo Advantage for a Peg-ln-Hole Task Using a 
Force-Feedback Manpiiator" by EH. Spain, SPIE Vbl. 
1256 Stereoscopic Displays and Applications, 1990, 
pps. 244-254. In the Bejczy at al article, force-torque 
feedback is disclosed. Also, in US Patent No 3,921 ,445, 
a manipulator which includes force, torque and slip sen- 
sors of a type which may be employed with the present 
invention is shown. 

A tele-existence master slave system is disclosed 
in an article entitled Tele- Existence Master Slave Sys- 
tem for Remote Manipulation (II)". Tachi, et al., Pro- 
ceedings of the 29th Conference on Decision and 
Control, Vol. 1 of 6, pp. 85-90. The system comprises a 
master system with a visual and auditory sensation of 
presence, computer control system and an anthropo- 
morphic slave robot mechanism with an arm having 
seven degrees of freedom. The operator's head and 
arm movements are measured by the master motion 
measurement system in real time. Sisals are then sent 
to four computers which generate a command position 
of the slave head and arm movements to correspond 
with the operator's head and arm movements. 

According to one aspect of the invention there is 
provided an endoscopic surgical instrument comprising 
a control section and an insertion section, the insertion 
section being adapted to be inserted into a patient 
through a small incision to a location adjacent a work- 
site in the patient; 

wherein the insertion section comprises a fore- 
arm link, a wrist fink and an end effector, wherein the 
forearm Bnkhas a proximal end. a cfetal end and a tore- 
arm axis extending longitudinally from the proximal end 
of the forearm link to the distal end of the forearm Dnk, 
the wrist link has a proximal end and a cfistal end and a 
wrist axis extending from the proximal end of the tore- 
arm link to the distal end of the forearm link, the proxi- 
mal end of the forearm link is connected to the control 



section, the cfistal end of the forearm link is connected to 
a pivotal wrist joint, and the proximal end of the wrist fink 
is connected to the pivotal wrist joint and the distal end 
of the wrist fink is connected to the end effector, charac- 
5 tarized in that: 

the control section comprises a plurality of control 
motors and linkages adapted to operate the inser- 
tion section with at least five degrees of freedom 
ro including: 

insertion and retraction of the forearm link along the 
forearm axis and through the small Incision; 
rotation of the forearm link about the forearm axis; 
pivotal motion of the forearm link about a first plv- 
75 otal axis and a second pivotal axis which are per- 
pendicular to each other and intersect the forearm 
axis at a pivot point adjacent the smal Incision; and 
pivotal motion of the wrist fink relative to the fore- 
arm link. 

20 

According to another aspect of the Invention there 
is provided an endoscopic surgical instrument compris- 
ing an insertion section and a control section, the inser- 
tion section being adapted to be inserted into a patient 

25 through a small incision to a location adjacent a work- 
site in the patient; 

wherein the insertion section comprises a fore- 
arm link, a wrist link and an end effector; wherein the 
forearm link has a proximal end, a distal end and a fore- 

30 arm axis extending longitudinally from the proximal end 
of the forearm to the distal end of the forearm; the wrist 
link has a proximal end and a cfistal end and a wrist axis 
extending from the proximal end of the forearm to the 
cfetal end of the forearm; the proximal end of the fore- 

55 arm link is connected to the control section, the cfistal 
end of the forearm link Is connected to a pivotal wrist 
joint; and the proxirral end of the wrist link is connected 
to the pivotal wrist Joint and the dtetal end of the wrist 
link connected to the end effector; characterized in that: 

40 

the control section comprises: 
means for inserting and retracting the forearm fink 
along the forearm axis and through the small inci- 
sion; 

45 means for rotating the forearm link about the fore- 
arm axis; 

means for pivoting the forearm link about a first piv- 
otal axis and a second pivotal axis which are per- 
pendicular to each other and intersect the forearm 
so axis at a pivot point adjacent the smal incision; and 
means of pivoting the wrist link relative to the fore- 
arm fink so as to control the angle between the fore- 
arm axis and the wrisi axis. 

55 Thus manipulators located at a worksite are con- 
trolled by hand-operated means at a remote operator 
control station. End effectors at the manipulators are 
used for manipulating objects located In a workspace at 
the worksite, and force-torque feedback is employed for 
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transmitting back to the operator mechanical resistance 
encountered by the end effectors. Sterecgraphic visual 
display means provide the operator with an image of trie 
workspace. In accordance with the present invention, 
the image is located adjacent the hand-operated means 5 
so that the operator looks in the cfrection of the hand- 
operated means for viewing the knage adjacent the 
hand-operated means. Either a real or virtual image of 
the workspace may be provided adjacent the hand- 
operated means. Display means for display of a real 10 
image may be located adjacent the hand-operated 
means for direct viewing of the real image by the opera- 
tor. For display of a virtual image of the workspace, a 
mirror is located between the operator's eyes and the 
hand-operated means. In this case, display means pro- 75 
vide a real image which is inverted from top to bottom, 
which inverted image is viewed via the mirror, which 
mirror inverts the image and provides the operator with 
a virtual image of the workspace, which appears to be 
located adjacent the hand-operated means. By locating 20 
the image ol the workspace adjacent the hand-operated 
means the operator is provided with a sense that the 
end effectors and hand-operated means are substan- 
tially internal debits the fact the end effectors are 
located at the worksite and the hand-operated means 25 
are located at the remote operator's station. A stereo- 
phonic sound system may be Included to provide the 
operator with stereophonic sound from the worksite. 
Video camera means are provided for viewing the work- 
space from which an image of the workspace is 30 
obtained. Nferious other sensors and associated 
responders may be located at the worksite and opera- 
tor's station, respectively, for transmission of pressure, 
tactile, heat, vibration and similar information for 
enhanced telepresence operation. 35 

Dependng upon the application, different scaling 
may be provided in the transmission of information 
between the operator's station and worksite. For exam- 
ple, for microassembfy, microsurgery and Ifoe opera- 
tions involving small part manipulation, optical and/or 40 
video magnification may be enployed to provide an 
enlarged 3-tfmenstonal image for viewing by the opera- 
tor. With similar scaing between the hand operated 
means and manipulators, the perception of the operator 
is substantially that which a miniature operator would 45 
have were he at the worksite. 

PRIEF DESCRIPTION OF THE DRAWINGS 

The invention, together with other objects and so 
advantages thereof, will be better understood from the 
following description co nsi d er ed with the accompanying 
drawings. It wffl be understood that the drawings are for 
purposes of illustration and example only, and that the 
invention is not Dmited thereto. In the drawings, wherein ss 
like reference characters refer to the same parts in the 
several views, 

Fig. 1 is a diagrammatic showing of a teleoperator 



system embodying the present invention including 
side elevational views of a worksite and remote 
control operator's station; 
Fig. 2 is an enlarged rear elevational view of the 
operator's station taken stfcstarrtialry along line 2-2 
of Figure 1; 

Fig. 3 is an enlarged rear elevational view of the 
worksite taken substantial along line 3-3 of Frgure 
1: 

Fig. 4 Is a simpliled side elevational view which Is 
similar to Figure 1 and showing cfimensional rela- 
tionships between elements at the worksite and 
elements at the operator's station; 
Fig. 5 is a diagrammatic view to ilustrate visual per- 
ception by a miniature virtual eye, and Fig. 6 is a 
rJagrammatfc view to illustrate visual perception by 
the operator when Image magnification Is 
employed; 

Fig. 7 is a diagrammatic view which is similar to that 
of Fig. 1 but showing the teleoperator system used 
for telepresence surgery; 

Fig. 8 is a rear elevational view of the operator's sta- 
tion shown in Fig. 7; 

Fig. 9 is a rear elevatianal view of the worksite 
shown in Fig. 7; 

Figs. 10 and 11 are fragmentary side elevational 
views of modified forms of operator's station and 
manipulator, respectively, having increased 
degrees of freedom; 

Fig. 1 2 is a side elevational view of a modified form 
of operator's station wherein dteplay means are 
positioned for cfirect viewing by the operator; 
Fig. 13 is a rear elevational view of the modified 
form of operator's station shown in Fig. 12; and 
Fig.14 shows a fragmentary portion of the insertion 
portion of an endoscope for use with the present 
invention. 

Reference now is made to Fig* 1-3 wherein the 
teleoperator system is shown to include an operator's 
station 20 (Figs. 1 and 2) and worksite 22 (Figs. 1 and 
3). An operator 18 at the operator's station controls 
manipulator means 24 at the remote worksite. Manipu- 
lator means 24, comp r i si ng right and left manipulators 
24R and 24L respectively, are used for manipulating 
objects, such as object 26 which is shown located on a 
platform, or base, 28 within a workspace 30 shown in 
broken ines. For purposes of illustration only, and not by 
way of limitation, the right manipulator 24R is shown to 
conprise a housing 32R affixed to base 28 and from 
which housing a telescopic arm 34R extends. 7Tie inner 
end 34R1 of arm 34R is mounted for pivotal movement 
In any pivotal direction using conventional mounting 
means. For example, the inner end of arm 34R may be 
mounted tor pivotal movement about a horizontal pivot 
axis 36 which pivot axis, in turn, is adapted for pivotal 
movement about vertical axis 38. 

Arm 34R includes telescopic Inner section 34R1 
and outer section 34R2, which outer section is adapted 
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both for axial movement into and out of inner section 
34R1 and fa rotation about its longitudinal axis. An end 
effector 40R Is carried at the outer end of the arm which, 
for purposes of illustration, is 6hown to comprise a grip- 
per. Motor means, not shown, control pivotal movement 5 
of arm 34 R about pivot axes 36 and 38, axial and rotary 
movement of outer arm section 34R2 along and about 
the longitudinal axis of the arm, and opening and clos- 
ing of gripper 40 R. The motor means, together with 
motor control circuits for control of the motors, may be 70 
included in housing 32R. The motors are under control 
of a computer 42 connected thereto through right 
manipulator interface 44R and the above-mentioned 
motor control circuits. 

The left manipulator 24L is of substantially the 15 
same design as the right manipulator 24R and the same 
reference numerals, but with the suffix L instead of R, 
are used to identify similar parts. For purposes of {lus- 
tration, the left end effector 40L. shown In Fig. 3, Is seen 
to comprise cutting blades which operate to cut in the 20 
manner of a pair of scissor blades. 

The worksite is provided with a pair of video cam- 
eras 46R and 46L for viewing workspace 30 from differ- 
ent angles for production of stereoscopic signal outputs 
therefrom at fines 48R and 48L The angle t between 25 
the optical axes of the cameras shown in Rg. 3 is sub- 
stantially equal to the operators interocular viewing 
angler of an image of the workspace as shown in Fig. 
2. 

The video camera outputs at lines 48R and 48L are 30 
supplied to an image memory 50 for momentary stor- 
age of video fields of right and left images from the c^ 
eras. Fields of right and left Images from image memory 
50 are alternately sippiied through leftfright switch 
means 52 to visual dsplay means 54, such as a televi- 55 
sion monitor, lor alternate display of the two images at 
the face 54A of the monitor. Timing and control means 
56 provide timing and control signals to various ele- 
ments of the system, Inducting elements included in the 
stereographic display system, for signal timtngandcon- aq 
trol of the system. If digital storage means 50 are 
employed, then conversion of the camera signal outputs 
to digital signal form by analog to digital converter 
means prior to storage, and conversion of the digital sig- 
nal output from leftfright switch means to analog signal 45 
form in preparation for display at monitor 54 may be 
employed. 

An electroopticaJ device 58 at the face of the display 
means 54 controls polarization of light received from 
display means 54 under control of a left/right synchro- so 
razing signal from liming and control unit 56. The left 
and right image fields are viewed by operator 16 wear- 
ing a pair of passive polarized glasses 60 having right 
and left polarizing elements 62 and 64 polarized in 
orthogonal directions. The polarization of light from dis- ss 
play 54 through electrooptical device 58 is synchronized 
field by field such that the rltfit field is occluded from the 
left eye and the left field is occluded torn the right eye 
for stereographic viewing by the operator. Other means 



tor stereographic viewing of left and right image fields 
are well known, including, for example, those using 
active stereographic glasses, which may be used In the 
practice of this invention to provide the operator with a 
stereoscopic view of the remote workspace. 

The vertical deflection coO connections for monitor 
54 are reversed, causing the monitor to scan from bot- 
tom to top thereby creating a top-to-bottom inverted 
Image 301 of workspace 30. Letters a, b, c and d are 
used to identify corresponding corners of the work- 
space 30 and inverted workspace image 301. The 
Inverted workspace image 301 is viewed by the operator 
via a mirror 66 at the top of a table 68, which mirror 
Inverts Image 301 to return the Image as viewed by the 
operator to an upright position. Looking downwardly in 
the direction of the mirror, the operator views a virtual 
image 30V of workspace 30. In accordance with one 
aspect of the present invention, the image viewed by the 
operator, which In the Fig. 1-3 embodiment comprises a 
virtual image, is located adjacent controler means 70 
used by the operator for control of manipulator means 
24attheworksita 

Controller means 70 are shown located beneath 
the table top 68 and include right and left controllers 
72R and 72L for control of the respective right and left 
manipulators 24R and 24L The right and left controllers 
are of substantially the same design so that a descrip- 
tion of one apples to both. As with the manipulators, the 
suffixes R and L are used to cfistinguish elements of the 
right controller from those of the left controller. For pur- 
poses of ilustration, and not by way of limitation, the 
right controller 72R is shown to comprise a support 74R 
affixed to the bottom of table top 68 and from which 
hand-operated means 76R in the form of a telescopic 
control arm, or stick, extends. 

The right and left control arms 76R and 76L are 
provided with the same degrees of freedom as the 
associated manipulator arms 34R and 34L, respec- 
tively. For example, the inner end of control arm 76R is 
mounted for pivotal movement about a horizontal pivot 
axis, correspond rcg to manipulator pivot axis 36, which 
axis, in turn, is adapted for pivotal movement about an 
intersecting vertical axis, corresponding to manipulator 
axis 38. Control arm 76R also includes inner section 
76R1 and outer section 76%, which outer section is 
adapted both for axial movement into and out of inner 
section 76R1 and for rotation about its longitudinal axis. 
It will be apparent that the control arm 76R is provided 
with the same four degrees of freedom as the associ- 
ated manipulator arm 34 R. Additionally, sensor means 
78R are located adjacent the outer end of outer arm 
section 76R2 for use in controlling gripping action of 
gripper 40R. Similar sensor means 78L adjacent the 
outer end of control arm 76L are adapted for use in con- 
trolling operation of scissor blades 40L 

Right and left controllers 72R and 72L are included 
in a servomechanlsm system wherein mechanical 
motion of control arms 76R and 76L controls the posi- 
tion of manipulator arms 34R and 34L, and pressure on 
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sensor means 78R and 78L controls opening and dos- 
ing of end effec tor s 40R and 40L, respectively. In Fig. 1, 
right and left tend controller interfaces 80R and 80L, 
respectively, are shown for connection of the controllers 
to computer 42. Servomechanisms for control of 5 
mechanical motion at a remote location are well known, 
Inducing those which provide force and torque feed- 
back from the manipulator to the hand-operated control- 
ler means. Any suitable prior art servomechanism may 
be used in the practice of the present invention, with 10 
those incorporating force and torque feedback being 
particularly preferred for telepresence operation of the 
system. In the illustrated system, right and left micro* 
phones are included at th e worksite, outputs from which 
microphones are amplified by right and left amplifiers 75 
and supplied to right and left speakers at the operators' 
station for providing a stereophonic sound output to pro- 
vide the operator with an audio perspective present at 
the workspace. In Fig. 1, only the right channel of the 
stereophonic system is shewn induding right micro- 20 
phone 82R, right anpHier 86R and right speaker 88R. 
The left microphone and speaker are located cfrectty 
behind the respective right microphone and speaker at 
the worksite and operator's control station as viewed In 
Fig. 1. Obviously, earphones may be provided for use by 25 
the operator in place of the speakers which would help 
to block out external noises at the operator's control sta- 
tion. Also, in Fig. 1 a light shield 54B at the monitor is 
shown for blocking direct viewing of the monitor face by 
the operator. 30 

Reference now is made to Fig. 4 wherein a simpli- 
fied diagrammatic view of the system illustrated in Figs. 
1-3 Is shown and wherein various lengths and angular 
positions are identified by reference characters. In Fig. 
4, the optical path length between the cameras and a ss 
point F at the workspace Is Identified by reference char- 
acter L A corresponding path length between the oper- 
ator's eyes and point F at the virtual image of the 
workspace is identified by the distance a+b, where a is 
the distance from the eyes of the operator to mirror 66, 40 
and b is the distance from the mirror to pofrrt Fat the vir- 
tual image. Other dimensions shown include the height 
Q of the cameras above the pivot point of manipulator 
arm 34R and corresponofng height g of the operator's 
eyes above the pivot point of control arm 76R. With the 45 
control arm 76R at length d. the manipulator arm 34R 
adjusts to length D. Similarly, with the control arm 76R 
at an angle p A with the vertical, the manipulator arm 
34R is positioned at the same angle from vertical. The 
angle from vertical at which the cameras view the work- so 
space and the eyes view the virtual imaged the work- 
space is identified by o. 

Between elements of the worksite and operator sta- 
tion, the following relationships pertain: 

55 

a+b=W_ (1) 
d - kD , and (2) 



g » kQ (3) 

where k is a scale factor constant. When k 
equals 1 such that a+b«L, d = D and g°Q, no 
seating of worksite dimensions is required. 

Any scale factor may be employed, the invention 
not being limited to foil-scale manipulation. For exam- 
ple, the worksite can be small, including microscopic in 
size, in which case the optical parameters, including dis- 
tance to object Interccular distance and focal length, 
and mechanical and dimensional parameters are 
appropriately scaled. 

By using appropriate scafing and image magna ica- 
tion and force and torque feedback, and by locating the 
image 30V of the workspace 30 adjacent hand-oper- 
ated control means 76R and 76L, the operator is pro- 
vided with a strong sense of directly controlling the end 
effectors 40R and 40L The operator is provided with a 
sense that the end effectors 40R and 40L and respec- 
tive control arms 76R and 76L are substarrtiaBy integral. 
This same sense of togetherness of the hand-operated 
control means and end effectors Is not provided in prior 
art arrangements wherein the image viewed by the 
operator is not located aofacent the hand-operated con- 
trol means. Even where the prior art includes stereo- 
scopic viewing and force and torque feedback, there is 
a feeling of disconnectedness of the hand motions from 
the visual image object being worked upon. TTie present 
invention overcomes this sense of disconnectedness by 
locating the workspace image where the operator's 
hands appear to exercise direct control over the end 
effectors. 

For small-scale manipulation, such as required for 
surgical applications, it is desired to replicate the visual 
experience that a miniature observer would have were 
he closely adjacent the actual worksite. In Fig. 5, the vir- 
tual eye 90 of a hypothetical miniature observer is 
shown viewing an actual workspace. Light from a 
sowce at a point X, Y, Z in the actual workspace pro- 
duces a stimulus on the miniature observer's eye 90 at 
a point identified as X7M. In Fig. 6, an eye 92 of an 
actual operator is shown viewing an enlarged image of 
the virtual workspace produced by means of a video 
camera 94 used to view the actual workspace. The Blus- 
trated camera includes a Bght-receiving lens 96 and 
solid state imaging device such as a charge-coupled- 
device (CCD) array 98 where the point tight source at X, 
Y, Z Is shown imaged at point Xj. Y h Zj. With correct 
scaing, a corresponding lipji source is produced at 
point MXf, MY|, MZj at either the real or apparent posi- 
tion of the face of the visual cfisplay which, due to stere- 
oscopic operation of the system appears to the operator 
to originate from point MX, MY, MZ corresponding to 
point X,Y,Z at the actual workspace, At the retina of the 
actual eye 92, a stimulus is produced at point X* at pro- 
portionatery the same position as point XVM at eye 90 of 
the hypothetical observer. This relationship is ensured 
by selecting a correctly scaled camera distance and 
lens focal length such that the optical magnification 
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M 0 » WM V where M is the desired overal magnifica- 
tion and is the video magnification. A typical video 
magnification, which equals the ratio of the CCD- 
array 96 width to the display width, is about 40. 

Reference now is made to Figs. 7 through 9 s 
wherein a modified form of this invention is shown lor 
medical use. Hera, right and left manipulators 1 00R and 
100L are shown which are under control of right and left 
controllers 102R and 102L, respectively. Elements of 
the imaging system are substantially the same as those io 
employed in the imaging system illustrated in Figs. 1 -3 
described above except that an enlarged virtual Image 
1 04V of actual workspace 104 is provided for viewing by 
the operator. Also, servomechanism elements for con- 
nections the right and left cor^lere^ is 
the respective manipulators 100R and 1001. are sub- 
stantially the sarrra as those described above with refer* 
ence to Figs. 1-3. In the illustrated arrangement, the 
right and left manipulators are of substantially the same 
construction as are the right and left controllers, such 20 
that a description of one manipulator and one controller 
apples to both. Again, suffixes R and L are used to dis- 
tinguish between right and left elements thereof. 

The manipulators include outer control sections 
100RA and 100LA and insertion sections 100RB and 25 
100LB, which insertion sections are adapted for inser- 
tion into a body cavity through cylindrical tubes, or can- 
nulas, not shown. For purposes of illustration, the 
manipulators are shown inserted through the abdomen 
wall 1 06 of a subject As is weO understood, for laparo- so 
scopic surgical procedures, wall 106 is separated from 
internal organs by insufflation wherein a gas is intro- 
duced into the abdomen by any suitable means not 
shown. Manipulator motors and associated motor con- 
trol circuits are contained in the outer control sections as 
tOORAand 100LA of the manipulators for control of the 
insertion section. The manipulators* together with a 
laparoscope 108 for viewing organs within the cavity, 
are carried by a fixed ral 1 1 0 forming part of a surgical 
table upon which the subject is supported. 40 

The Insertion sections 100RB and 100LB of the 
manipulators may be of substantially the same design 
as manipulator arms 34R and 34Ldescribed above with 
reference to the Figs. 1-3 embodiment The insertion 
sections are of relatively small size for use inside the 4S 
body. Insertion section 100RB includes telescopic inner 
section 112R1 and outer section 112R2, which outer 
section Is adapted for both axial movement into and out 
of inner section 1 12R1 and for rotation about its longitu- 
dinal axis. End effectors 114Rand 114L are carried at so 
the outer ends of the respective right and left sections 
112R2 and 112L2 for manipulation of organ 116. The 
Inner section 112R1 is adapted for pivotal movement 
about intersecting perpendicular axes located substan- 
tially at point P where the Insertion section intersects ss 
wall 106. Exclusive of operation of end effectors 114R 
and 1 14L the manipulator arms each are provided with 
four degrees of freedom, the same as In the errtxxfi- 
ment shown in Rgs 1-3. End effectors 114R and 114L 



simply may comprise, essentially; microsurgical instru- 
ments with their hardies removed including, for exam- 
ple, retractors, etedrosurglca) cutters and coagulators, 
microforceps, microneedle holders, dissecting scissors, 
blades, irrigators, and sutures. 

Laparoscope 108 for viewing the workspace 104 is 
shown comprising an outer operating section 108 A and 
insertion section 108B. Trie outer end section 120 of 
insertion section 108B Is axially and rotatabry movable 
within the Inner end 1 22 thereof, and is provided with a 
pair of image transmission windows 1 24,124 for stereo- 
scopic viewing of workspace 1 04. The laparoscope also 
is provided with illuminating means, not shown for illumi- 
nating the workspace, and with Squid Inlet and outlet 
means, not shown, for flow of liquid past the windows. 
Video camera means within section 108A are respon- 
sive to Dght received through the viewing windows for 
generation of left and right electronic images at output 
lines 48R and 48L for connection to Image memory 50. 
A magnified 3<fimenskmi image 1041 is produced at 
display means 54 for viewing by the operator wearing 
cros^-poiarized glasses 60 via mirror 66. As with the 
embodiment shown in Figs. 1-3, a virtual image 104V of 
the workspace 104 is produced adjacent control arms 
130R and 130L of controllers 102R and 102L Control 
arms 130R and 130L are of the same type as control 
arms 76R and 76L included in the Figs. 1-3 embodi- 
ment described above. They include telescopic inner 
and outer sections 132R1 and 132R, and 132L1 and 
132L2. Sensor means 134R and 134L located adjacent 
the outer ends of the control arms control operation of 
end effectors 114R and 114L, respectively, in the man- 
ner described above with reference to Figs. 1-3. It here 
wiD be noted that the angle from vertical at which the 
image is viewed by the operator need not equal the 
angle from vertical at which the object Is viewed by the 
cameras. In the arrangement ilustrated in Figs. 7-9, the 
operator is shown to view the image 1 04V at an angl e 6 
from vertical (Fig. 7) whereas the object 116 is shown 
as viewed directly downwardly. With no external refer- 
ence, the sense of vertical within a body is not particu- 
larly great and no confusion is produced in the mind of 
the operator as a result of the different observer and 
camera viewing angles relative to vertical. 

With the Figs. 7-9 embodiment, not only is a magni- 
fied virtual image 104V of the workspace provided for 
viewing by the operator, but control arms 130R and 
1 20L of p/eater length than the length of the manipula- 
tor insertion sections 100RB and 100LB are employed. 
Servomechanism scaling of axial movem en t of the tele- 
scopic control arms is provided such that axial exten- 
sion or retraction thereof results in a &naller extension 
or retraction of the telescopic insertion sections. Angu- 
lar pivotal motion of the control arms 130R and 130L 
produces the same angular pivotal motion of Insertion 
sections 1 00RB and 100 LB, and rotational movement of 
the end sections 132R2 and 132L2 of the control arms 
produces the same rotational motion of end sections 
112R2 and 112L2 of the insertion sections of the right 
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and left manipulators, without scaling. This embodiment 
of the invention, with Its magnified image, is of particular 
use in the area of microsurgery, and especially In those 
cases where the surgeon cannot reach an area by hand 
because of size constraints. 

The present invention is not limited to use with 
manipulators having any particular number of degrees 
of freedom. Manipulators with different degrees of free- 
don which are well known in the art may be used in the 
practice of this invention, in Figs. 10 and 11, to which 
reference now is made a controller 140 and manipulator 
142, respectively; are shown which include a wrist Joint 
to provide the same with additional freedom of move- 
ment. The Illustrated controller 140 includes a housing 
144 affixed to the bottom of table top 68 upon which 
table mirror 66 is located. An enlarged virtual image 
146V of actual workspace 146 is provided adjacent the 
operator 1 * hand 148 viewable by the operator when 
looking downwardly onto the mirror 66 in a manner 
described above. 

A control arm 1 SOL comprising Inner and outer sec- 
tions 150L1 and 150L2, respectively, is mounted within 
housing 144 tor pivotal movement in any pivotal direc- 
tion as indicated by intersecting doiAte-headed arrows 
152 and 154. The outer section 150L2 is adapted for 
axial movement into and out of inner section 150L1 in 
the direction of double-beaded arrow 156. It also is 
adapted for rotation about its longitudinal axis in the 
direction of double-headed arrow 156. in this embodi- 
ment, the control arm includes an end section 160 piv- 
otally attached to outer section 1 50L2 by wrist Joint 1 62 
for pivotal movement in the direction of double-headed 
arrow 164. End section 160 comprises axiaily aligned 
Inner and outer sections 1 60A and 160B,the outer sec- 
tion 1 60B of which is rotatable about its longitudinal axis 
In the direction of double-beaded arrow 166. As with the 
above-described arrangements, sensor means 168 are 
located adjacent the free end of the control arm for 
operation of an end effector 170 at manipulator 142 
shown in Fig. 11. 

Referring to Fig. 11, end effector 170 is shown to 
oomprise a pair of movable jaws attached to a wrist 172 
comprising axiaDy aligned links 172A and 172a Outer 
link 172B is rotatable about its longitudinal axis relative 
to inner link 172A by motor means, not shown, in the 
direction of double-headed arrow 166M in response to 
rotation of section 160B of the hand-operated control 
unit in the direction of arrow 166. Wrist link 172A ispiv- 
otally attached to manipulator forearm 174 for pivotal 
movement in the direction of double-headed arrow 
164M in response to pivotal movement of end section 
160 of the hand -operated control means about pivot 
axis 162. Forearm 174 is longitudinally axiaily movable 
in the (Erection of double-headed arrow 156M in 
response to axial movement of outer section 150L2 of 
control arm 150L in the direction of double-headed 
arrow 156. ft also is rotatable about Hs longitudinal axis 
In the direction of double-headed arrow 158M in 
response to rotation of outer section 150L2 of control 



arm 150L in the direction of double-headed arrow 156. 
AdcfitionaUy, it is pivotally movable about point 1 76 in the 
directions of double-headed arrows 152M and 154M in 
response to pivotal movement of control arm 150L in 

5 the directions of double-headed arrows 152 and 154, 
respectively. For biomedical use; such as remote lapar- 
oscopic surgery, pivot point 176 is substantia^ located 
at the level of abdominal wad 178 through which the 
manipulator extends. InRg, 11, nrtanipu!atorarm174is 

io shown extending through a cannula 180 which pene- 
trates the abdominal wail. 

The outer operating end of the manipulator is 
adapted for attachment to a supporting rail, not shown, 
of the surgery table tpon which the subject is sup- 
ra ported. It includes an end effector drive motor 182 for 
opening and closing of gripper 170. Wrist drive motor 
1 84 controls pivotal movement of wrist 1 72 in the direc- 
tion of double-headed arrow 164M, and extension drive 
motor 1 86 controls axial movement of manipulator arm 

20 174 in the direction of double-headed arrow 156M. 
Forearm pivotal control motors and linkages. Identified 
generafly by reference numeral 188. provide for pivotal 
movement of arm 1 74 about pivot point 1 76 in the (Erec- 
tions of arrows 152M and 154M. Pivotal motion about 

25 point 176 is provided by simultaneous lateral movement 
of the outer operating end of the manipulator and pivotal 
movement of arm 174. Movements are coordinated 
such that the center of rotation of forearm 1 74 is fixed in 
space at point 176 at the level of the abdominal wall. 

so Controller 140 and manipulator 142, are included in 
a system such as shown in Figs. 7, 8 and 9 which 
includes a second controler and rranipuiator for use by 
the operator's right hand, and associated servomecha- 
nlsm means of any suitable type, not shown, for remote 

35 control of the manipulators by the hand-operated con- 
trollers. Video camera means at the worksite, such as 
shown in Rg. 9, together with cfeplay means, such as 
shown in Fig. 7, are employed for providing the operator 
with an image of the workspace at a location adjacent 

40 the left and right hand-operated control means. By 
using manipulators with a wrist Joint an added degree 
of freedom is provided for increased maneuverability 
and usefulness thereof. However, as noted above, the 
present invention is not limited to use with manipulators 

45 with any particular degree of freedom. 

Reference now is made to Figs. 12 and 13 wherein 
a mocfif ied form of this invention is shown which pro- 
vides for direct viewrg of a 3-dbnensional knage240lof 
a workspace, not shown. In Figs. 12 and 13, only the 

so operator's station is shown, which includes right and left 
controlers 242R and 242L and associated right and left 
hand-operated means 244R and 244L which may be of 
the same type as controllers and control arms 
described above. The operator's station is adapted for 

55 remote control of manipulators which also may be of the 
above-described type. The 3-dimensional image 2401 of 
the workspace is provided by visual display means 246 
In conjunction with electrooptical device 58 at the face of 
the cfisplay means and cross-polarized glasses 60 worn 
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by the operator, to which display means left and right 
video fields from left and right video cameras that view 
the workspace are alternately supplied, all In the man- 
ner descrbed in detaD above. End effector and object 
Images 248 and 250, respectively, are shown within the 
workspace image as viewed by video cameras at the 
worksite. The display means 246 is located adjacent the 
left and right hand-operated means 244R and 244Lfbr 
direct viewing by the operator. With this arrangement 
the end effector and object images together with the 
hand-operated means 244R and 244L are simultane- 
ously viewable by the operator. Since the hand-oper- 
ated means also are visible, the operator is provided 
with a visual sense off connection between the end 
effector means and hand-operated means whereby 
they appear substantia^ as being integral. 

Reference now Is made to Fig. 14 wherein the distal 
end portion, or tip, 260 of the insertion section of an 
endoscope is shown which is of substantially the same 
type as shown in the above-mentioned pubficaticn enti- 
tled "Introduction to a New Project for National 
Research and Development Program (Large-scale 
Project) in FY 1991" which endoscope may be used in 
the practice of the present invention. The insertion end 
of the endoscope includes a pair of spaced viewing win- 
dews 262R and 262Land an illumination source 264 for 
viewing and illuminating a workspace to be observed. 
Light received at the windows is focused by objective 
lens means, not shown, and transmitted through fiber- 
optic bundles to a pair of cameras at the operating end 
of the endoscope, not shown. The camera outputs are 
converted to a ^dimensional image of the workspace 
which image is located adjacent hand-operated means 
at the operator's station, not shown. Right and left steer- 
able catheters 268R and 266L pass through accessory 
channels in the endoscope body, which catheters are 
adapted for extension from the distal end portion, as 
illustrated. End effectors 270R and 270L are provided at 
the ends off the catheters which may comprise conven- 
tional endoscopic instruments. Force sensors, not 
shown, also are inserted through the endoscope chan- 
nels. SteeraUe catheters which include control wires for 
contrdfng bendmg of the catheters and operation of an 
end effector suitable for use with this invention are wel 
Known. Control motors for operation of the control wires 
are provided at the operating end of the endoscope, 
which motors are included in a servomechanism of a 
type described above for operation of the steerable 
catheters and associated end effectors from a remote 
operator's station. As with the other embodiments, the 
interlacing computer in the servomechanism system 
remaps the operator's hand motion into the coordinate 
system of the end effectors, and Images of the end 
effectors are viewable adjacent the hand-operated con- 
trollers in a manner described above. WHh this errtxxf- 
ment, the operator has the serration of reaching 
through the endoscope to put his hands directly on the 
end effectors for control thereof. Endoscopes of differ- 
ent types may be employed in this em bo di ment of the 



invention so long as they indude one or more accessory 
channels for use in control of end effector means, and 
suitable viewing means fbr use in providing a visual dis- 
play of the workspace. Fbr example, gastric, cdon- 
5 scopic, and like type, endoscopes may be employed. 

The invention having been descrbed in detail in 
accordance with requirements of the Patent Statutes, 
various other changes and modifications will suggest 
themselves to those skilled In this art For example, as 

» rated above, the inverrtkxi may 

feedback to provide the subtle sensations for palpation 
and tor manipulating tissues and instruments, lb pro- 
vide this feedback, tactile sensor arrays may be 
Included on the end effectors which are coupled to tao- 

75 tie sensor stimulator arrays on the hand-operated con- 
trol m^rts, which reproduce the tactile sensation on the 
operator's hands. A variety of transduction technologies 
for teleoperator tactile sensing are known including 
resistive/conductive, semiconductor, piezoelectric 

20 capacitive and photoelectric. Hand-operated control 
means and manipulators of different types may be 
employed using a wide variety of well-known mecha- 
nisms and electromechanical elements including, for 
example, gimbals, linkages, pulleys, cables, drive belts 

25 and bands, gears, optical or electromagnetic po&tion 
encoders, and angular and linear motors. Force feed- 
back to the operator requires use of body contact with 
hand-operated du^U ol means. Both hand grip type hand 
controllers such as those illustrated, and control brace 

so type hand control ers are wel adapted for use with the 
present invention for force feedback to the operator. 
Control brace hand controllers include use of structures 
with positive sensors mounted on the operator at Joints 
for measuring joint angles. Force feedback then can be 

3S applied to each joint SimBarty, light fabric gloves with 
variable-resistance or fiber-optic flex sensors mounted 
on the joints fbr measuring bending of individual fingers 
may be used. Gloves of this type also may be provided 
with force feecfoack to provide fbr telepresence interac- 

40 tion with real objects. Regardless of the type of hand- 
operated control means employed, an image off the 
workspace is produced adjacent thereto to provide th e 
operator with a sense that the end effector means and 
hand-operated control means are substantially integral. 

45 Also, as noted above, servomechanisms of many differ- 
ent types are well known in the robotic and teleoperator 
system arts, and the invention is not fimited to any par- 
ticular type. Those that include force and torque feed- 
back to the operator are preferred to contribute to a 

so telepresence sense of operation. In addition, many dif- 
ferent means tor producing a stereoscopic image off th e 
workspace are known. For example, instead of using 
two cameras, a single camera may be employed 
together with switched cross-polarizing elements in the 

ss Image receiving path. In this case, a pair of spaced ster- 
eoscopic lenses are used for viewing the workspace 
from different angles and providing first and second 
Images thereof to the camera. In the Fig. 9 arrange- 
ment, wherein a laparoscope is shown, other types of 
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endoscopes ray be used for viewing the workspace. As 
noted above, the invention Is not limited to any particular 
application or usa In the biomedical field, uses Include, 
for example, open surgery, including surgery from a 
remote location, microsurgery, and minimum invasive 
surgery such as laparoscopic and endoscopic surgery. 
Laboratory use Including microscopic manipulation also 
Is contemplated. Industrial use of the invention include, 
for example, hazardous materials handling, remote 
operations, mlcroassemtty, and the like. Mffitary and 
undersea use of th e teleoperator system of this system 
are apparent 

Claims 

1. An endosc opic surgical instrument (142) compris- 
ing a control section (143) and an Insertion section 
(145), the insertion section (145) being adapted to 
be Inserted frrto a patient through a small incision 
(180) to a location adjacent a worksite (22) in the 
patient; 

wherein the Insertion section (145) com- 
prises a forearm fink (1 74), a wrist link (1 72) and an 
end effector (170), wherein the forearm link (174) 
has a proximal end, a tistal end and a forearm axis 
extending longitudinally from the praama) end of 
the forearm link (174) to the distal end of the fore- 
arm link (174), the wrist link (172) has a proximal 
end and a distal end and a wrist axis extending from 
the proximal end of the forearm link (1 74) to the (fe- 
tal end of the forearm link (1 74), the proximal end of 
the forearm link (174) is connected to the control 
section (143), the cfstal end of the forearm Ifik 
(174) is connected to a pivotal wrist Joint and the 
proximal end of the wrist link (172) is connected to 
the pivotal wrist Joint and the distal end of the wrist 
link (172) is connected to the end effector (170), 
ch ara cte r ized in that: 

the control section (143) comprises a plurality 
of control motors and linkages (182: 184, 186, 
188) adapted to operate the insertion section 
(145) with at least five degrees of freedom 
inducting: 



2. The endoscopic surgical instrument (142) as 
deserted in claim 1 wherein the wrist ink (172) 
comprises an Inner link (172A) and an outer link 
(172B) and wherein the control section (143) is 
5 adapted to operate the Insertion section (145) with 
at least six degrees of freedom including movement 
of the outer Dnk (172B) of the wrist link (172) rela- 
tive to the Inner link (172A) of the wrist link (172). 

io 3. The endoscopic surgical Instrument (142) as 
described in daim 2 wherein the outer link (172B) 
of the wrist Onk (172) and the inner link (172A) of 
the wrist link (172) are axialty aligned and wherein 
the control section (143) is adapted to rotate the 
79 outer link (172B) relative to the inner link (172A). 

4. The endoscopic surgical Instrument (142) as 
deserted in daim 1 wherein the end effector (170) 
comprises a first element and a second element 

20 and wherein the control section (143) is further 
adapted to move the first element relative to the 
second element 

5. The endoscopic surgical instrument (142) as 
25 described in daim 2 wherein the end effector (170) 

comprises a first element and a second element 
and wherein the control section (143) is further 
adapted to move the first element relative to the 
second element 

50 

6. The endoscopic surgical Instrument (142) as 
described in daim 1 wherein the end effector (170) 
comprises a surgical instrument (142) head 
selected from the group of retractors, electrosurgl- 

3s cal cutters, etectrosurgical coagulators, forceps, 
needle holders, scissors, blades and irrigators. 

7. The endoscopic sifglcal Instrument (142) as 
described in claim 1 wherein the control section 

40 (143)isadaptedtobefixedtoasi<)portraa(l10)of 
a surgical table for support of the surgical manipu- 
lator during surgery. 

8. An e n d os copic surgical instrument (142) compris- 
ing an insertion section (145) and a control section 
(143), the insertion section (145) being adapted to 
be inserted into a patient through a small incision 
(180) to a location adjacent a worksite (22) in the 
patient; 

wherein the insertion section (145) com- 
prises a forearm link (1 74), a wrist link (1 72) and an 
end effector (170); wherein the forearm link (174) 
has a proximal end, a distal end and a forearm axis 
extending longitudinally from the proximal end of 
the fbrearm to the distal end of the forearm; the 
wrist link (172) has a proximal end and a distal end 
and a wrist axis extending from the proxfrnal end ol 
the forearm to the distal end of the forearm; the 
proximal end of the forearm link (174) is connected 



insertion and retraction of the forearm Ivik 
(174) along the forearm axis and through 
the small indsion (180); 
rotation of the forearm Gnk (174) about the 
forearm axe; so 
pivotal motion of the forearm link (174) 
about a f irst pivotal axis and a second piv- 
otal axis which are perpendicular to each 
other and intersect the forearm axis at a 
pivot point adjacent the small Incision ss 
(180); and 

pivotal motion of the wrist link (172) rela- 
tive to forearm Erik (1 74). 



io 3. 
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to the control section (143), the distal end of the 
forearm ink (174) is connected to a pivotal wrist 
Joint; and the proximal end of the wrist link (172) is 
connected to the pivotal wrist joint and the distal 
end of the wrist Dnk (172) connected to the end 5 
effector (170); characterized In that: 

the control section (143) comprises: 

means tor Inserting and retracting the tore- 10 
arm link (174) along the forearm axis and 
through the small Incision (180); 
means tor rotating the forearm link (174) 
about the forearm axis; 

means tor pivoting the forearm link (174) is 
about a first pivotal ass and a second piv- 
otal axis which are perpendicular to each 
other and intersect the forearm axis at a 
pivot point adjacent the smal incision 
(180); and 20 
means for pivoting the wrist fink (172) rela- 
tive to the forearm link (174) so as to con- 
trol the angle between the forearm axis 
and the wrist axis. 

25 

9. The surgical manipulator as described in claim 8 
wherein the wrist fink (1 72) comprises an inner link 
(172A) and an outer ink (172B) and wherein the 
control section (143) further comprises means for 
moving the outer ink (1 72B) of the wrist link (172) so 
relative to the inner link (172A) of the wrist link 
(172). 

10. The surgical manipulator as described in claim 9 
wherein the outer link (1 72B) of the wrist link (172) 35 
and the Inner ink (172A) of the wrist link (172) are 
axially aligned and wherein the control section 
(143) further comprises means tor rotating the 
outer ink (1 72B) relative to the inner ink (1 72A). 

40 

11. The surgical mardptiator as described in clakn 8 
wherein the end effector (1 70) comprises a first ele- 
ment and a second element and wherein the con- 
trol section (143) further comprises means tor 
moving the first element relative to the second ele- 4s 
merit. 

12. The surgical manipulator as described in claim 9 
wherein the end effector (170) comprises a first ele- 
ment and a second element and wherein the con- so 
trol section (143) further comprises means tor 
moving the first element relative to the second ele- 
ment. 

13. The surgical manipulator as described in claim 10 ss 
wherein the end effector (170) comprising a surgi- 
cal instrument head selected from the group of 
retractors, eiectrosurglcal cutters, eiectrosurgical 
coagutators, forceps, needle holders, scissors, 



blades and irrigators. 

14. The surgical manipulator as described in claim 10 
wherein the control section (143) firth er comprises 
means tor mounting the control section (143) on a 
support ral (110) of a surgical table for supporting 
the surgical manipulator during a surgical proce- 
dure. 
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(54) An endoscopic surgical instrument 

(57) An endoscopic surgical instrument (142) com- 
prising a control section and an insertion section, the 
insertion section being adapted to be inserted into a 
patient through a small incision (180); wherein the inser- 
tion section (145) comprises a forearm link (174), a 
wrist link (172) and an end effector (170), wherein the 
forearm link (174) has a proximal end, a distal end and 
a forearm axis extending longitudinally from the proxi- 
mal end of the forearm fink (174) to the distal end of the 
forearm link (174), the wrist link (172) has a proximal 
end and a distal end and a wrist axis extencing from the 
proximal end of the forearm link (174) to the distal end 
of the forearm link (174), the proximal end of the fore- 
arm Or* (174) is connected to the control section (143), 
the distal end of the forearm Dnk (174) is connected to a 
pivotal wrist joint, and the proximal end of the wrist link 
(1 72) is connected to the pivotal wrist Joint and the distal 
end of the wrist Dnk (1 72) is connected to the end effec- 
tor (170), characterized in that the control section com- 
prises a plmlity of control motors and linkages (182, 
184, 186, 188) adapted to operate the insertion section 
with at least five degrees of freedom inducing: insertion 
and retraction of a forearm link (1 74) along the forearm 
axis and through the small incision (180); rotation of the 
forearm Bnk (1 74) about the forearm axis; pivotal motion 
of the forearm link (174) about a first pivotal axis and a 
second pivotal axis which are perpendicular to each 
other and intersect the forearm axis at a pivot point 
adjacent the small incision (180); and pivotal motion of 
a wrist Onk (1 72) relative to the forearm link (1 74). 
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